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ABSTRACT 



An ultrasonic imaging system and method acquire funda- 
mental mode and harmonic mode ultrasonic image signals 
from a subject with a transducer. These image signals are 
then combined to form a composite image. This composite 
image includes a nearfield image region modulated prima- 
rily as a function of the fundamental mode ultrasonic image 
signals, and a middlefield or farfield image region modu- 
lated primarily as a function of the harmonic mode image 
signals. In this way, excellent images can be obtained 
throughout the imaged range. 

28 Claims, 4 Drawing Sheets 
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ULTRASONIC IMAGING SYSTEM AND 
METHOD FOR DISPLAYING COMPOSITE 
FUNDAMENTAL AND HARMONIC IMAGES 

BACKGROUND 5 

This invention relates to ultrasonic imaging systems and 
methods, and particularly to ultrasonic imaging systems and 
methods that utilize both harmonic and fundamental imag- 
ing modes. 

Ultrasonic imaging systems that combine ultrasonic 
images from multiple transmit beams to form a single 
improved image are described for example in U.S. Pat. Nos. 
5,568,813; 5,111,824; 5,462,057; and 5,579,770. The meth- 
ods described in these patents however do not address the 15 
issue of providing high image quality in harmonic images of 
technically difficult examinations. 

Hossack et al. U.S. patent application Ser. No. 08/638, 
918, assigned to the assignee of the present invention, 
discloses a method and system that combine nearfield har- 2 o 
monic imaging and farfield fundamental imaging to create a 
single improved image. This application also discloses a 
system and method that combine a nearfield image which is 
an amplitude matched combination of fundamental and 
harmonic signals with a farfield fundamental image to form 2 5 
a single improved image. 

In spite of the improvements provided in the above 
identified Hossack application, a need presently exists for an 
ultrasonic imaging system and method that provide 
improved nearfield imaging, particularly for use in harmonic 30 
imaging systems used to image tissue without added non- 
linear contrast agent. In such cases, particularly in techni- 
cally difficult examinations, the nearfield and farfield per- 
formance may be less than optimum because of small 
nonlinear propagation distances in the nearfield and 35 
decreases in the signal to noise ratio in the farfield. 

SUMMARY 

The present invention is denned by the following claims, 
and nothing in this section should be taken as a limitation on 40 
those claims. By way of introduction, it can be stated that the 
method and apparatus described below acquire fundamental 
mode ultrasonic image signals and harmonic mode ultra- 
sonic image signals from a subject. The fundamental and 
harmonic mode image signals are combined to form a 45 
composite image, which includes a nearfield image region 
that is modulated primarily as a function of the fundamental 
mode ultrasonic image signals, and a middlefield or farfield 
image region that is modulated primarily as a function of the 
harmonic mode ultrasonic image signals. By using the 50 
fundamental mode image signals preferentially in the 
nearfield, image quality is enhanced. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of an ultrasonic imaging system 55 
that incorporates a presently preferred embodiment of this 
invention. 

FIG. 2 is a schematic diagram of a composite image 
generated with the system of FIG. 1. 6Q 

FIGS. 3 and 4 are graphs of fundamental and harmonic 
weighting functions, respectively, used in the formation of 
the image of FIG. 2. 

FIGS. 5 and 6 are two separate fundamental weighting 
functions suitable for use in forming the image of FIG. 2. 55 

FIG. 7 is a block diagram of a method practiced by the 
system 10 of FIG. 1. 
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FIG. 8 is a block diagram of another ultrasonic imaging 
system that incorporates a preferred embodiment of this 
invention. 

FIG. 9 is a schematic view of a composite image formed 
with the system of FIG. 8. 

FIGS. 10 and 11 are graphs of fundamental and harmonic 
weighting functions, respectively, suitable for use in forming 
the image of FIG. 9. 

DETAILED DESCRIPTION OF THE 
PRESENTLY PREFERRED EMBODIMENT 

Turning now to the drawings, FIG. 1 shows a block 
diagram of a medical ultrasonic imaging system 10 that 
provides improved image quality by combining nearfield 
fundamental, middlefield harmonic, and farfield fundamen- 
tal images together to create a composite image providing 
improved resolution throughout the displayed depth. 

The system 10 includes a transmit beamformer 12, a 
transmit/receive switch 14, a phased transducer array 16, a 
receive beamformer 24, a filter 26, a scan converter 30, and 
a display 32. The transmit beamformer 12 generates shaped 
transmit waveforms so that the transmitted harmonic fre- 
quency power is suppressed. The receive beamformer 24 is 
operative to form an acoustic beam at either the received 
fundamental frequency, or at a harmonic of the received 
fundamental frequency, such as the second harmonic for 
example. The filter 26 is adjustable to pass either the 
fundamental signals or the harmonic signals. The scan 
converter 30 is operative to store at least two received 
acoustic beams and to splice them into a single scan line as 
described below. 

FIG. 2 is a schematic diagram of a composite image 40 
formed on the display 32 of FIG. 1. The image 40 includes 
five separate regions: a nearfield region 42, a middlefield 
region 46, a farfield region 50, a nearfield compounded 
region 44, and a farfield compounded region 48. The terms 
nearfield, middlefield, and farfield are not intended to define 
any specific ranges. Rather, these terms define relative 
ranges, with the nearfield being the closest to the transducer 
array 16 of FIG. 1. 

In this embodiment, the system 10 generates a fundamen- 
tal beam and a harmonic beam along the same azimuth al 
direction, and then combines the two to form a single scan 
line with two piece -wise linear weighting functions as 
shown in FIGS. 3 and 4. The fundamental weighting func- 
tion 60 of FIG. 3 has a magnitude of one in the nearfield 
region 42 and the farfield region 50. The function 60 
decreases linearly from one to zero in the nearfield com- 
pounded region 44, and remains at zero in the middlefield 
region 46 before increasing linearly from zero to one in the 
farfield compounded region 48. Although the function 60 is 
shown as a linear function in the two compounded regions 
in FIG. 3, nonlinear functions can also be used. 

The harmonic weighting function 62 of FIG. 4 is formed 
by subtracting the function 60 from 1, such that the sum of 
the two weighting functions 60, 62 is equal to 1 at any depth. 

The fundamental and harmonic beams are combined in 
the scan converter by multiplying the fundamental beam by 
the fundamental weighting function 60 of FIG. 3, multiply- 
ing the harmonic beam by the harmonic weighting function 
62 of FIG. 4, and then summing the weighted fundamental 
and harmonic beams to create a composite beam that is used 
for display purposes. 

In another embodiment, the system 10 is operated to 
acquire a first fundamental beam having a nearfield transmit 



5,897 ; 

3 

focus, a harmonic beam having a middle field transmit focus, 
and a second fundamental beam having a farfield transmit 
focus. These three acquired beams are then combined to 
produce a composite beam. The combination is performed 
using the harmonic weighting function 62 of FIG. 4 for the 5 
harmonic beam. In this case, the first, nearfield fundamental 
beam is weighted with the fundamental weighting function 
70 of FIG. 5, and the second, farfield fundamental beam is 
weighted with the fundamental weighting function 72 of 
FIG. 6. The weighted first and second fundamental and 10 
harmonic beams are then added together to create the 
composite beam that is displayed. 

This method practiced by the system 10 in forming the 
composite image 40 is flow charted in FIG. 7. As shown in 
step 76, the first step in this method is to acquire the required 15 
image signals. In this case three separate image signals are 
acquired, each along the same azimuthal direction. The first 
image signal Fl is a fundamental mode image signal 
acquired with a nearfield transmit focus. The second image 
signal H is a harmonic mode image signal acquired with a 20 
middlefield transmit focus. The third image signal F2 is a 
second fundamental mode image signal acquired with a 
farfield transmit focus. 

The next step 78 in the method of FIG. 7 is a combining 
step which includes two component parts. First, the three 25 
image signals Fl, H and F2 acquired in step 76 are weighted 
or multiplied by weighting functions 70, 62, and 72, 
respectively, as shown in FIGS. 5, 4 and 6. The final portion 
of the combining step 78 is to sum the weighted image 
signals Fl, H and F2 to form the composite image signal that 30 
is displayed. The method is then continued with the next set 
of image signals as appropriate to obtain the composite 
image signal for the next scan direction. 

The acquiring step 76 is performed by the elements 12 35 
through 26 of FIG. 1, and the combining step 78 of FIG. 7 
is performed by the scan converter 30 of FIG. 1. 

FIG. 8 is a block diagram of another ultrasonic imaging 
system 80 that can be used to practice alternative embodi- 
ments of this invention. The system 80 includes a transmit 40 
beamformer 12, a transmitreceive switch 14, and a trans- 
ducer array 16 as described above. 

The system 80 includes two separate receive beamformers 
86, 88. The receive beamformer 86 forms a receive beam at 
the fundamental frequency F 0 , while the receive beam- 45 
former 88 forms a receive beam at a second harmonic 
frequency 2F 0 . The fundamental and harmonic receive 
beams are applied to filters 90, 92, respectively, before they 
are combined in the scan converter 94. The combined signal 
is then supplied for display on the display 32. Because both 50 
the fundamental and the receive beams are acquired from the 
same transmit event, the system 80 improves frame rates and 
reduces motion artifacts as compared to the system 10 of 
FIG. 1. 

It is not essential in all embodiments that fundamental 55 
signals be used in the farfield. For example, in the situation 
where the display depths are all relatively shallow, a com- 
posite image 100 such as that shown in FIG. 9 can be used. 
The image 100 is divided into three regions; a nearfield 
region 102, a farfield region 106, and a compounded region 60 
104. The terms nearfield and farfield are not intended to 
define any specific ranges, but are instead intended to define 
relative ranges, with the nearfield being closer to the trans- 
ducer array 16 than the farfield. The imaging systems 10 and 
80 of FIGS. 1 and 8 can both be used to generate the 65 
composite image 100 of FIG. 9. For example, the piecewise 
linear fundamental weighting function 110 (FIG. 10) and 
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harmonic weighting function 112 (FIG. 11) can be used to 
weight the nearfield fundamental data and the farfield har- 
monic data, respectively. As before, nonlinear weighting 
functions can be used if desired. 

The method performed by the imaging system 80 of FIG. 
8 includes acquiring and combining steps similar to those of 
FIG. 7, except in this case only a single fundamental mode 
image signal with a nearfield transmit focus and a single 
harmonic image mode image signal with a farfield transmit 
focus are obtained along each azimuthal direction. The 
elements 12 through 14 and 86 through 92 perform the 
acquiring step, and the scan converter 94 performs the 
combining step. 

The embodiments described above provide the advan- 
tages of improved nearfield imaging performance. This 
improvement in nearfield imaging performance results in an 
overall image quality that is improved and preserved 
throughout the imaging depth in technically difficult exami- 
nations. 

Of course the present invention can be implemented in 
many other ways. The harmonic and fundamental mode 
image signals can be acquired using the widest variety of 
filtering and demodulation techniques. Transmit focal length 
can be varied as desired, and both single and multiple 
transmit focus techniques can be used. The multiple image 
signals combined to form the composite image signal can be 
obtained in parallel or sequentially. Various beamformers, 
filters and the like can be used, including those employing 
analog and digital signal processing techniques. 

Similarly, the image signals can be combined to form the 
composite image signal using many techniques, including 
look up tables and analog or digital circuits for scaling and 
summing signals. The combining step can be performed at 
any desired point in image signal processing after beam 
formation, and the compounded regions discussed above are 
not required in all applications. 

This invention can be used both with and without the 
addition of nonlinear contrast agent to the region being 
imaged. When contrast agent is added, it can be of any 
suitable type, including a variety of microbubbles. Particular 
advantages are obtained when no contrast agent is added to 
the region of interest throughout the imaging session, which 
may correspond to a medical diagnostic examination. In this 
case, the harmonic signal return from the nearfield portion of 
the imaged region is particularly weak, and improved 
nearfield images are obtained by using the fundamental 
image signal for the nearfield region as discussed above. 

As used herein, the terms fundamental and harmonic 
mode image signals are intended broadly. Fundamental 
mode image signals are formed primarily in response to 
ultrasonic echoes at the same ultrasonic frequency as the 
dominant transmitted ultrasonic frequency. Harmonic mode 
ultrasonic image signals are formed primarily in response to 
ultrasonic echoes having a frequency different from that of 
the dominant transmitted ultrasonic frequency. The term 
harmonic is intended broadly to encompass subharmonics, 
fractional harmonics, and integral harmonics of two or 
greater. Second harmonic image modes have been found to 
be particularly useful in clinical applications. 

As pointed out above, the term farfield is intended to 
signify a portion of the imaged tissue farther from the 
transducer than middlefield, which is in turn farther from the 
transducer than nearfield. The absolute ranges may vary 
broadly. 

When an imaged region is said to be modulated primarily 
as a function of a fundamental or a harmonic image signal, 
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the term primarily is intended broadly to include image 
regions that are modulated solely as a function of the 
respective harmonic or fundamental signals. 

The foregoing detailed description has described only a 
few of the many forms that the present invention can take. 5 
For this reason, this detailed description is intended as an 
illustration of specific forms of the invention, and not as a 
definition of the invention. It is only the following claims, 
including all equivalents, that are intended to define the 
scope of this invention. 10 

I claim: 

1. An ultrasonic imaging method comprising the follow- 
ing steps: 

(a) acquiring fundamental mode ultrasonic image signals 
and harmonic mode ultrasonic image signals from a 15 
scanned region with a transducer; 

(b) combining the fundamental and harmonic mode image 
signals of step (a) to form a composite image, said 
composite image comprising a first image region that is 
modulated primarily as a function of the fundamental 20 
mode ultrasonic image signals and a second image 
region that is modulated primarily as a function of the 
harmonic mode ultrasonic image signals, portions of 
the scanned region associated with the first image 
region being closer to the transducer than portions of 25 
the scanned region associated with the second image 
region. 

2. The method of claim 1 wherein the first and second 
image regions comprise nearfield and farfield regions, 
respectively, of the composite image. 30 

3. The method of claim 1 wherein the first and second 
image regions comprise nearfield and middlefield regions, 
respectively, of the composite image. 

4. The method of claim 1 wherein the composite image 
formed in step (b) further comprises a third, farfield region 35 
that is modulated primarily as a function of the fundamental 
mode ultrasonic signals. 

5. The method of claim 1 wherein the composite image 
formed in step (b) further comprises a compounded region 
intermediate the first and second image regions, said com- 40 
pounded region modulated as a function of both the funda- 
mental mode image signals and the harmonic mode image 
signals. 

6. The method of claim 4 wherein the composite image 
formed in step (b) further comprises first and second com- 45 
pounded regions, said first compounded region intermediate 
the first and second image regions, said second compounded 
region intermediate the second and third image regions, said 
first and second compounded regions modulated as respec- 
tive functions of both the fundamental mode image signals 50 
and the harmonic mode image signals. 

7. The method of claim 4 wherein step (a) comprises the 
step of acquiring the fundamental mode image signals as 
nearfield fundamental mode image signals with a nearfield 
transmit focus and as farfield fundamental mode image 55 
signals with a farfield transmit focus, wherein the first region 

of the composite image is modulated primarily as a function 
of the nearfield fundamental mode image signals and the 
third region of the composite image is modulated primarily 
as a function of the farfield fundamental mode image 60 
signals. 

8. The method of claim 2 wherein step (a) comprises the 
step of acquiring the fundamental mode image signals with 
a nearfield transmit focus and the step of acquiring the 
harmonic mode image signals with a farfield transmit focus. 65 

9. The method of claim 1 wherein step (a) is performed 
during an ultrasonic medical diagnostic examination 
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session, further comprising the step of (c) maintaining the 
subject free of added non-linear contrast agent throughout 
the examination session. 

10. A medical ultrasonic diagnostic composite image 
comprising: 

a first image region modulated primarily as a function of 
fundamental mode ultrasonic image signals acquired 
from a nearfield portion of a subject; 

a second image region modulated primarily as a function 
of harmonic mode ultrasonic image signals acquired 
from a portion of the subject at greater ranges than the 
nearfield portion. 

11. The invention of claim 10 wherein the first and second 
image regions comprise nearfield and farfield regions, 
respectively, of the composite image. 

12. The method of claim 10 wherein the first and second 
regions comprise nearfield and middlefield regions, 
respectively, of the composite image. 

13. The method of claim 10 wherein the composite image 
further comprises a third, farfield region that is modulated 
primarily as a function of fundamental mode ultrasonic 
image signals acquired from a farfield portion of the subject. 

14. The invention of claim 10 wherein the composite 
image further comprises a compounded region intermediate 
the first and second image regions, said compounded region 
modulated as a function of both the fundamental mode 
image signals and the harmonic mode image signals. 

15. The invention of claim 13 wherein the composite 
image further comprises first and second compounded 
regions, said first compounded region intermediate the first 
and second image regions, said second compounded region 
intermediate the second and third image regions, said first 
and second compounded regions modulated as respective 
functions of both the fundamental mode image signals and 
the harmonic mode image signals. 

16. The invention of claim 14 wherein the composite 
image further comprises first and second compounded 
regions, said first compounded region intermediate the first 
and second image regions, said second compounded region 
intermediate the second image region and a third image 
region, said first and second compounded regions modulated 
as respective functions of both the fundamental mode image 
signals and the harmonic mode image signals. 

17. An ultrasonic imaging system comprising: 

means for acquiring fundamental mode ultrasonic image 
signals and harmonic mode ultrasonic image signals 
from a scanned region with a transducer; 

means for combining the fundamental and harmonic 
mode image signals to form a composite image, said 
composite image comprising a first image region that is 
modulated primarily as a function of the fundamental 
mode ultrasonic image signals and a second image 
region that is modulated primarily as a function of the 
harmonic mode ultrasonic image signals, portions of 
the scanned region associated with the first image 
region being closer to the transducer than portions of 
the scanned region associated with the second image 
region. 

18. The invention of claim 17 wherein the first and second 
image regions comprise nearfield and farfield regions, 
respectively, of the composite image. 

19. The invention of claim 17 wherein the first and second 
regions comprise nearfield and middlefield regions, 
respectively, of the composite image. 

20. The invention of claim 17 wherein the composite 
image further comprises a third, farfield region that is 
modulated primarily as a function of the fundamental mode 
ultrasonic signals. 
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21. The invention of claim 17 wherein the composite 
image further comprises a compounded region, intermediate 
the first and second image regions, said compounded region 
modulated as a function of both the fundamental mode 
image signals and the harmonic mode image signals. 

22. The method of claim 20 wherein the composite image 
further comprises first and second compounded regions, said 
first compounded region intermediate the first and second 
image regions, said second compounded region intermediate 
the second and third image regions, said first and second 
compounded regions modulated as respective functions of 
both the fundamental mode image signals and the harmonic 
mode image signals. 

23. The invention of claim 20 wherein the acquiring 
means comprises means for acquiring the fundamental mode 
image signals as nearfield fundamental mode image signals 
with a nearfield transmit focus and as farfield fundamental 
mode image signals with a farfield transmit focus, wherein 
the first region of the composite image is modulated prima- 
rily as a function of the nearfield fundamental mode image 
signals and the third region of the composite image is 
modulated primarily as a function of the farfield fundamen- 
tal mode image signals. 
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24. The invention of claim 18 wherein the acquiring 
means comprises means for acquiring the fundamental mode 
image signals with a nearfield transmit focus and means for 
acquiring the harmonic mode image signals with a farfield 

5 transmit focus. 

25. The invention of claim 17 wherein the acquiring 
means comprises means for acquiring the fundamental and 
harmonic mode image signals sequentially. 

26. The invention of claim 17 wherein the acquiring 
10 means comprises means for acquiring the fundamental and 

harmonic mode image signals in parallel. 

27. The method of claim 1, 10 or 17 wherein the first 
region is modulated substantially only as a function of the 
fundamental mode ultrasonic image signals, without any 

15 substantial contribution from the harmonic mode ultrasonic 
image signals. 

28. The method of claim 1, 10 or 17 wherein the second 
region is modulated substantially only as a function of the 
harmonic mode image signals, without any substantial con- 

20 tribution from the fundamental mode ultrasonic image sig- 
nals. 
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